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@ Dynamic touchscreen button adjustment mechanism. 

© A computer based touchscreen includes a 
mechanism for displaying buttons on the 
touchscreen indicating the location where an 
user has touched the touchscreen. Because 
different operators wfll view the buttons from 
different angles, they will, touch the touchsc- 
reen in different positions. An initial button or 
series of buttons of the application that the user 
is using is configured to sense the location 
where the user is touching. These initial but- 
ton^) are called adjusting buttons. The button 
sensing regions for the remaining buttons 
(non-adjusting buttons) are calibrated from 
these initial touched locations. For example, if 
the user tends to press high and to the right of 
the adjusting button(s), the orientation of the 
button sensing regions for the remaining but- 
tons is calibrated high and to the right If multi- 
ple adjusting buttons are used, the average of 
the touched positions is used to calibrate the 
button sensing regions of the non-adjusting 
buttons. The adjusting buttons are not restric- 
ted to the beginning of the application. Any 
screen that displays buttons can be used to 
calibrate or recalibrate the button sensing reg- 
ion for subsequent non-adjusting buttons. This 
allows for greater accuracy should the users 
change their view or angle of the touchscreen 
as they use the application. Thus, the computer 
dynamically adjusts the orientation of a 
touchscreen button's sensing region based on 
the location that the user has pressed for previ- 
ous buttons. This dynamic adjustment allows a 
high density of buttons to be displayed on the 
touchscreen. 
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This invention relates to the data processing 
field. More particularly, this Invention relates to a 
touchscreen apparatus for adjusting a sensing region 
based on the location that the user touches on the 
touchscreen, which is contained in a display. 

Touchscreens are well known in the art where the 
user communicates a desired action to a computer by 
touching a touchscreen in a specific location. The 
computer system displays graphics on the 
touchscreen that represent buttons. The user inter- 
faces to the computer system by touching the 
touchscreen in a displayed button's sensing region, 
which is the area on the touchscreen that the comput- 
er system associates with the button. The computer 
system detects the user's touch, maps the touched lo- 
cation to a particular button, and performs appropri- 
ate functions based on the button that the user select- 
ed via the touch. 

Touchscreens are advantageous in that they can 
eliminate the need for a keyboard or other input de- 
vice in applications where a separate input device 
would be cumbersome, expensive, or susceptible to 
vandalism. Also, with a touchscreen the user is not 
forced to read instructions in one place and hunt else- 
where, such as on a keyboard, for keys to press. In- 
stead, the instructions that the user reads and the 
buttons that the user touches are in the same prox- 
imity. This close proximity of instructions and buttons 
is more convenient and faster for the user and reduc- 
es the chance of incorrect button selection. 

However, touchscreens suffer from the problem 
that the buttons on the touchscreen are two dimen- 
sional, and although the buttons are visually distinct 
from one another, they are not physically distinct from 
one another. Thus, while a user of a conventional key- 
board can fee] when a finger is straying over the edge 
of the intended key and onto an adjacent, unintended 
key, the user of a touchscreen cannot feel when a fin- 
ger is straying over the edge of a button. These prob- 
lems are exacerbated by the fact that the touchscreen 
has thickness, so while the button is projected onto 
the back of the touchscreen, the user touches it from 
the front This screen thickness plus the parallax ef- 
fect, causes different users to perceive the same but- 
ton in potentially different places. For example, tall 
users standing to the right of the touchscreen will tend 
to perceive the button as being above and to the right 
of the actual button position, so they will tend to touch 
high and to the right of the button sensing region. Ana- 
logously, short users standing to the left of the 
touchscreen will tend to perceive the button as being 
below and to the left of the actual button position, so 
they will tend to touch low and to the left of the button 
sensing region. 

The cumulative effect of these problems causes 
users to be unsure of whether or not they have touch- 
ed the intended button, especially when the buttons 
are small and close together. In contrast, on a conven- 



tional keyboard, users can be reasonably confident 
that they have depressed the intended key because 
the key is three dimensional, moves downward when 
pressed, and is tactilely separate from adjacent keys. 

5 The prior art touchscreens attempt to solve these 

problems by the computer system either displaying 
the button over a larger than desired area or utilizing 
a larger than desired button sensing region associat- 
ed with the button. Both these solutions severely lirrv 

10 ited the density and orientation of displayed buttons 
on the touchscreen. 

For the foregoing reasons, there is a need for a 
touchscreen that allows a high density of displayed 
buttons with accurate selection of buttons by users 

15 who are viewing the touchscreen from a variety of 
view angles. 

It is an object of the present invention to provide 
an enhanced touchscreen. 

It is a further object to allow a high density of dis- 

20 played buttons with accurate selection of buttons to 
be used on a touchscreen apparatus. 

It is a further object to allow accurate selection of 
buttons on a touchscreen apparatus by users viewing 
the touchscreen from all view angles. 

25 These and other objects are achieved by the 
computer system dynamically adjusting the orienta- 
tion of a touchscreen button's sensing region based 
on the location that the user has touched for a previ- 
ous button or buttons. 

30 An initial button or series of buttons of the appli- 
cation that the user is using is configured to sense the 
location where the user is touching. These initial but- 
ton^) are called adjusting buttons. The button sens- 
ing regions for the remaining buttons (non-adjusting 

35 buttons) are calibrated from these initial touched lo- 
cations. For example, if the user tends to press high 
and to the right of the adjusting button(s), the orien- 
tation of the button sensing regions for the remaining 
buttons Is calibrated high and to the right If multiple 

40 adjusting buttons are used, the average of the touch- 
ed positions is used to calibrate the button sensing re- 
gions of the non-adjusting buttons. 

The adjusting buttons are not restricted to the be- 
ginning of the application. Any screen that displays 

45 buttons can be used to calibrate or recalibrate the but- 
ton sensing region for subsequent non-adjusting but- 
tons. This allows for greater accuracy should the 
users change their view or angle of the touchscreen 
as they use the application. 

so Fig. 1 shows the parallax effect, present in a 
touchscreen, which causes different view angles 
to result in different users perceiving the button 
at different locations; 

Fig. 2 shows a prior art touchscreen button and 
55 sensing region; 

Fig. 3 shows users viewing the touchscreen of the 
preferred embodiment, which is shown in this ex- 
ample as a ticket kiosk, from different angles; 
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Figs. 4a and 4b show an example of a seat selec- 
tion screen of the preferred embodiment, which 
allows a high density of buttons on the screen; 
Fig. 5 shows a block diagram of the computer sys- 
tem of the preferred embodiment; 5 
Figs. 6a, 6b, 6c, 6d, and 6e show the button list, 
.factor list and adjustment factor of the preferred 
embodiment and their relationships to the button 
sensing region; and 

Figs. 7, 8, and 9 show the flowcharts that de- 10 
scribe the operation of the preferred embodi- 
ment. 

Fig. 1 is a side view of display 17 and shows the 
parallax effect, which causes different user view an- 
gles to result in different users perceiving button 20 is 
at different locations. Touchscreen 18 in display 17 
has thickness 23, which is the distance between 
touchscreen back 28 and touchscreen front 22. Al- 
though button 20 is projected onto the touchscreen 
back 28, users 24 and 26 will attempt to touch it on 20 
touchscreen front 22. Screen thickness 23 plus the 
parallax effect, causes different operators 24 and 26 
to perceive button 20 in different places. User 24 will 
perceive and attempt to touch button 20 at button lo- 
cation 29. In contrast, user 26 will perceive and at- 25 
tempt to touch button 20 at button location 21 , which 
in this example is lower on touchscreen 1 8 than but- 
ton location 29. 

Fig. 2 shows prior art display 67, touchscreen 68, 
touchscreen button 60, and button sensing region 64. 30 
Button sensing region 64 is the area of touchscreen 
68 associated with button 60 such that if the user 
touches within button sensing region 64, the comput- 
er system considers button 60 to have been touched. 
To solve the parallax problem illustrated in Fig. 1 , prior 35 
art touchscreens utilized button sensing regions 64 
that were larger than their corresponding buttons 60. 
The prior art solution illustrated by Fig. 2 is disadvan- 
tageous in that sensing regions 64 are large and thus 
limit the density and orientation of buttons 60 that 40 
may be concurrently displayed on touchscreen 68. 

Fig. 3 shows users 24 and 26 viewing button 20 
from different angles. Button 20a is displayed on 
touchscreen 1 8 in display 1 7. For purposes of i (lustra- 
tion, the application in this example is ticket kiosk 30. 45 
Because of the parallax effect and screen thickness 
23 described in Fig 1 ., tall user 24 standing to the right 
of ticket kiosk 30 will tend to view and press button 
20a above and to the right of its actual position. In 
contrast, short user 26, standing to the left of ticket so 
kiosk 30 will tend to view and press button 20a below 
and to the left of its actual position. To accommodate 
the differences in perception of different operators, 
this invention dynamically adjusts the button sensing 
regions, as will be shown in Figs. 4a, 4b, 6a, 6b, 6c, 55 
6d, and 6e, and explained in more detail in the flow- 
charts of Figs. 7, 8, and 9. 

Fig. 4a Illustrates display 17 and touchscreen 18 



of the preferred embodiment displaying an exemplary 
seat selection screen. In this example, the aggrega- 
tion of all buttons 20 represents a section of seats in 
a stadium. Users can touch a button to select the seat 
for which they. wish to purchase a ticket The buttons 
with an X through them represent seats that have al- 
ready been sold. For such a seat selection applica- 
tion, it is critical that the buttons be small with fine 
enough resolution to allow many seats to be dis- 
played close together. This invention allows a high 
density of buttons with fine resolution on touchscreen 
18 because the button sensing regions are dynami- 
cally adjusted to suit individual users, as will be 
shown in Fig 4b. 

Fig. 4b is a close up view of a few of buttons 20 
and their corresponding button sensing regions 34. In 
this example, each button sensing region 34 has 
been adjusted up and to the right to accommodate a 
user who tends to touch high and to the right of button 
20. Thus, button sensing region 34c is associated 
with button 20c. When the user touches within button 
sensing region 34c, the invention associates that 
touch with button 20c. Likewise, when the user touch- 
es within button sensing region 34d or 34e, the inven- 
tion associates that touch with buttons 20d or 20e re- 
spectively. In this way a high density of buttons 20 
can be displayed and selected on touchscreen 18. 

Fig. 5 shows a block diagram of computer system 
10 of the preferred embodiment of the invention. 
Computer system 10 has touchscreen 18 in display 
17 connected to system unit 11. System unit 11 con- 
tains processor 12 connected to memory 13, storage 
14, and display adapter 15. Processor 12 is suitably 
programmed to carry out this invention, as described 
in more detail in the flowcharts of Figs. 7, 8, and 9. 

In the preferred embodiment computer system 
1 0 is an IBM PS/2, storage 14 is a magnetic hard disk 
file, display adapter 15 is an IBM VGA display adap- 
ter, and display 17 is an IBM 8516 display. Computer 
system 10 could also be another type of computer 
system, whether it be another microcomputer such as 
an Apple Macintosh, a minicomputer such as an IBM 
AS/400, or a mainframe computer such as an IBM 
System/390, and still fall within the spirit and scope 
of this invention. In addition, computer system 10 
could be a microcomputer such as described above 
but connected to a larger computer system such as an 
IBM AS/400. 

Button list 46 defines button sensing region 34 
for each button 20. Factor list 47 contains a list of fac- 
tors that represent the difference between the center 
of button sensing region 34 and the locations that the 
user has touched. In the preferred embodiment ad- 
justment factor 48 is the average of the factors in fac- 
tor list 47. Button list 46, factor list 47, and adjustment 
factor 48 will be explained in more detail under the de- 
scription of Figs. 6a - 6e. 

Figs. 6a, 6b, 6c, 6d, and 6e show factor list 47, ad- 
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justment factor 48, and the relationship of button list 
46 to button 20 and button sensing region 34 in more 
detail. Button list 46 is a list of button entries. Each 
entry in button list 46 defines a button sensing region 
34 for a button 20 on touchscreen 1 8 via fields 49, 50, 5 
51, and 52. in the preferred embodiment there is a 
separate button list for every screen of buttons dis- 
played, but there could be just one button list for the 
entire application without departing from the inven- 
tion. In the preferred embodiment, buttons are dis- 10 
played as rectangles on the touchscreen, but the but- 
tons could be any geometric shape including, but not 
limited to, circles, ovals, or polygons with any number 
of sides. Field 50 defines the upper left point of button 
sensing region 34. Field 51 defines the lower right 15 
point of button sensing region 34. Field 52 defines the 
center of the button sensing region 34. In this exam- 
ple, locations on touchscreen 18 are defined by a 
(X,Y) coordinate system with X representing the hor- 
izontal axis and Y representing the vertical axis and 20 
location (0,0) representing the lower left hand corner 
of touchscreen 18. However, other methods of defin- 
ing locations on touchscreen 18 could be used with- 
out departing from the invention. Note that in this ex- 
ample since button sensing region 34 is a rectangle, 25 
it would not be necessary to include field 52 in button 
list 46 since it could be calculated from field 50 and 
field 51. 

In one preferred embodiment, there are two 
types of button entries in button list 46 associated 30 
with the two types of buttons. Type 49 in the button 
entry indicates whether the button entry is associat- 
ed with an adjusting button or a non-adjusting button. 
In one preferred embodiment, the locations that the 
user touches associated with adjusting buttons are 35 
used to calibrate the button sensing regions of sub- 
sequent non-adjusting buttons. In an alternative em- 
bodiment, the locations that the user touches associ- 
ated with adjusting buttons are used to remap subse- 
quent touched locations into the button sensing re- 40 
gions of non-adjusting buttons. In this example, but- 
tons 20a and 20b are adjusting buttons, while buttons 
20c, 20d, and 20e are non-adjusting buttons. In the 
preferred embodiment, adjusting buttons have button 
sensing regions that are larger than their associated 45 
buttons, and the button sensing regions for adjusting 
buttons do not move. In the preferred embodiment, 
non-adjusting buttons have button sensing regions 
that are the same size and shape as their associated 
buttons and the button sensing regions for the non- so 
adjusting buttons are calibrated based on where the 
user touched on the adjusting buttons. However, the 
button sensing regions could be other sizes or shapes 
without departing from the invention. 

In this example, button list 46 contains button en- 55 
tries 53, 54, 55, 56, and 57, which correspond to but- 
tons 20a, 20b, 20c, 20d, and 20e, and button sensing 
regions 34a, 34b, 34c, 34d, and 34e, respectively. In 



one preferred embodiment, adjusting buttons are dis- 
played to the user first, but adjusting and non-adjust- 
ing buttons could be displayed to the user in any or- 
der. Adjusting and non-adjusting buttons could share 
the same screen or be on different screens. 

Factor list 47 contains the differences between 
the location that the user touched on an adjusting but- 
ton and the center of button sensing region 34. In this 
example, factor list 47 contains two factors because 
there are two adjusting buttons in button list 46, each 
of which was touched once by the user. However, an 
application could have the user touch an adjusting 
button more than once, in which case there would not 
be a one-to-one correspondence between the num- 
ber of factors in the factor list and the number of ad- 
justing buttons in the button list 

In one preferred embodiment adjustment factor 
48 is set to be the average of all factors in factor list 
However, other methods of setting the adjustment 
factor could be used, including using the mean of the 
factors or weighting the recent factors more than the 
remote factors. 

The operation of one preferred embodiment as 
shown in the flowcharts of Figs. 7-9, will now be de- 
scribed in more detail. Referring to Fig. 7, block 601 
displays buttons on the touchscreen to the user. The 
number and configuration of the buttons displayed 
are dependent on the particular application that the 
user is accessing. When the user touches the 
touchscreen, block 605 determines the location that 
the user touched. Touchscreen s are well known in the 
art that provide the coordinates of the touched loca- 
tion via sensors on the touchscreen such as light 
emitting diodes and photo detectors. This invention is 
independent of the method of touched location deter- 
mination. Block 61 0 determines which button the user 
touched by calling the Determine Button Touched 
subroutine, which is described in detail in Fig. 8. 

Referring to Fig. 8, block 701 gets a button entry 
from button list 46. Block 705 checks to see if this but- 
ton entry is for an adjusting button. This check is ac- 
complished by examining type field 49 in the button 
entry. If this button entry is an adjusting button and 
the location that the user touched is within the button 
sensing region for this button entry, blocks 705 and 
710 are answered affirmatively. A new adjustment 
factor is computed by calling the Compute Adjustment 
Factor subroutine, which is described in Fig. 9. 

Referring to Fig. 9, block 765 computes a factor 
from the difference between the center of the sensing 
region and the touched location. If block 770 determi- 
nes that factor list 47 is fuil, the oldest factor from fac- 
tor list 47 is removed in block 775. This is necessary 
because the memory available to store factors is fin- 
ite. The newly calculated factor is inserted in factor list 
47 in block 780. Adjustment factor 48 is set to be the 
average of all factors in factor list 47 in block 785. Al- 
though the preferred embodiment sets the adjust- 
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ment factor to the average of the factors in the factor 
list, alternative embodiments could use another 
method, such as giving recent factors more weight 
than remote factors or using the mean of the factors. 
Block 790 returns control from the Compute Adjust- 5 
ment Factor Subroutine to block 730 in Fig. 8. Block 
730 returns an indication of which button was touch- 
ed to block 615 of Fig. 7. 

Referring to Fig. 8, if block 710 determines that 
the touched location is not within the sensing region 10 
for the button entry and if block 740 determines that 
there are button entries left in button 118146, then the 
next button entry in button list 46 is processed in 
block 701. If block 740 determines that there are no 
button entries left in button list 46, then the user has 15 
touched a location on the screen that is not associat- 
ed with any button, so an indication that no button 
was touched is returned in block 735 to block 615 in 
Fig. 7. 

Referring to Fig. 8, if block 705 determines that 20 
the button entry is for a non-adjusting button, then 
block 715 checks to see whether remap mode (alter- 
native embodiment) or calibrate mode (preferred em- 
bodiment) is desired. If block 715 determines that cal- 
ibrate mode is desired, block 717 sets the sensing re- 25 
gion to be the button location modified by adjustment 
factor 48. If block 715 determines remap mode is de- 
sired, block 719 modifies the touched location by the 
negative of adjustment factor 48. If block 725 deter- 
mines that the touched location is within the sensing 30 
region for the button list entry, then an Indication of 
which button was touched is returned in block 730 to 
block 615 of Fig. 7. If block 725 determines that the 
touched location is not within the button sensing re- 
gion for the button list entry, then if block 740 deter- 35 
mines that there are button entries left in the button 
list, then the next button entry in button list 46 is proc- 
essed in block 701 . If block 740 determines that there 
are no button entries left in button list 46, then the 
user has touched a location on the screen that is not 40 
associated with any button, so an indication that no 
button was touched is returned in block 735 to block 
615 in Fig. 7. 

Referring again to Fig. 7, if block 610 returned an 
indication that a button was touched, then block 615 45 
is answered affirmatively, so the appropriate proc- 
essing is performed for the touched button by the ap- 
plication that the user is accessing in block 620. If 
block 610 returned an indication that no button was 
touched, then the user has touched a location on the so 
touchscreen that is not associated with any button, so 
block 615 is answered negatively and block 625 dis- 
plays an error message to the user. In either event, 
block 601 displays a new screen of buttons on the 
touchscreen. 55 

While this invention has been described with re- . 
sped to the preferred and alternative embodiments, 
it will be understood by those skilled in the art that va- 



rious changes in detail may be made therein without 
departing from the spirit, scope, and teaching of the 
invention. For example, the type of applications that 
use a touchscreen may change from what is known 
today. In addition, touchscreen technology may be- 
come widely employed in consumer appl ications such 
as operator panels for consumer electronics, appli- 
ances, and automobiles. Accordingly, the herein dis- 
closed invention is to be limited only as specified in 
the following claims. 



Claims 

1. A touchscreen apparatus for receiving instruc- 
tions from a user, comprising: 

means for displaying a first button on the 
touchscreen, the first button having a first sensing re- 
gion; 

means for receiving an indication that the user touch- 
ed the touchscreen at a first location; 
means for determining that the first location is within 
the first sensing region of the first button; 
means for calculating an adjustment factor from the 
first button and the first location; and 
means for displaying a second button on the 
touchscreen, the second button having a second 
sensing region calibrated from the adjustment factor. 

2. The touchscreen apparatus of claim 1 wherein 
the calculating means further comprises: 

means for computing the difference between the cen- 
ter of the first sensing region and the touched loca- 
tion. 

3. The touchscreen apparatus of claim 1 , further 
comprising: 

means for receiving an indication that the user touch- 
ed the touchscreen at a second location; and 
means for determining that the second location is 
within the second sensing region. 

4. The touchscreen apparatus of claim 3, further 
comprising: 

means for calculating a second factor based on the 
distance of the second location from the center of the 
second sensing region; 

means for computing an adjustment factor by taking 
the average of the first factor and the second factor; 
and 

means for displaying a third button on the 
touchscreen, the third button having a third sensing 
region calibrated from the adjustment factor. 

5. The touchscreen apparatus of claim 4, further 
comprising: 

means for receiving an indication that the user touch- 
ed the touchscreen at a third location; and 
means for determining that the third location is within 
the sensing region of the third button; and 
means for performing processing in response to the 
user pressing the third button. 



5 



9 EP 0 618 ?28 A1 10 

9. The touchscreen apparatus of claim 1 , 3 or 5, 
wherein determining means further comprises: 
means for detecting that said location is within said 
sensing region, but not within said button, and report- 
ing that said button has been touched. 5 

7. The touchscreen apparatus of claim 1 , 3 or 5, 
wherein determining means further comprises: 
means for detecting that said location is within said 
sensing region and is also within said button, and re- 
porting that said button has been touched. 10 

8. The touchscreen apparatus of claim 1 , 3 or 5, 
wherein determining means further comprises: 
means for detecting that said location is within said 
button but is not within said sensing region, and re- 
porting that said button has not been touched. 15 
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